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IN THE UNITED STATES 
PATENT AND TRADEMARK OFFICE 



Patent Application 



j Inventors) Aviel D. Rubin Case Name Rubin 1999-0728 

| Martin J. Strauss 

Filing Date 4/20/2000 Serial No. 09/553,361 

Examiner M. Opsasnick Group Art Unit 2655 

! Title System and Method for Storage and Retrieval of Personal 

Communications in a Broadband Network 

COMMISSIONER FOR PATENTS 
P.O. Box 1450 
| Alexandria, VA 223 13-1450 
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! SIR: 

j AMENDMENT 

! In response to an Office action dated November 12, 2003, please amend the above- 

| identified application as follows: 
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IN THE CLAIMS: 

1. (Currently amended) A method executed in a customer premises apparatus of 
an individual for retaining broadband communications) , comprising the steps of: 

collecting digitiz e d information pack e ts of a communication s e ssion intend e d to 
communicoto with on individual ; 

adding at least a portion of a communication session in which sa id individual is a 
participant to a stored corpus of communication sessions: and 

automatically s e l e cting k e ywords from, and identifying keywords contained in T said 
at least a portion of a communication session , with aid of a module that operates without 
having received a )ist of said keywords pre-specified bv said individual, for creating a 
database of personal communications of said individual so as to permit subsequently 
searching through said database to find said at least a portion of said communication 
sessio n in said stored corpus . 



2. (Currently Amended) The method according to claim I, further comprising the 
steps of 

d e t e rmining if said digitiz e d information pack e ts contain voic e information j-an4 

converting voice information contained in said communication session digitiz e d 
information pack e ts into related text information, 

3. (Currently amended) The method according to claim 1, where said step of 
identifying is executed substantially contemporaneously with said step of adding, which 
occurs during said communication session or at conclusion of said communication session 
furth e r comprising th e st e p of storing at l e ast said digitiz e d information pack e ts sent by 
said individual , 

4. (Currently amended) The method according to claim 3, further comprising the 
steps of 

prompting said individual participating in said communication se ssion to specify 
d e t e rmin e pr e f e rr e d communication s e ssion identification terms and to be additionally 
used bv said module as said keywords; and 
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revising said identification terms and said keywords according to said preferred 
communication session identification terms and keywords. 

5. (Currently amended) The method according to claim 4, wherein said 
communication session comprises d igitized information pack e ts includ e s outgoing packets 
for communications sent by said individual and incoming packets for communications sent 
by a party to said individual. 

6. (Currently amended) The method according to claim 5, further comprising the 

step of: 

determining tf whether explicit approval has been given by said party to store said 
incoming packets for communications sent by said party. 

1. (Currently Amended) The method according to claim 6, further comprising the 

step of: 

appending to said corpus otorine to memory at least said outgoing packets of said 
digitiz e d information pack e ts . 

8. (Previously amended) The method according to claim 7, further comprising the 

step of: 

determining if said incoming packets for communications sent by said party are to 
be protected, and if so> protecting said incoming packets so that said individual cannot 
access said protected communication without an additional granting of permission by said 
party. 

9. (Currently Amended) The method according to claim 8, further comprising the 

step o& 

storing a ppending said incoming packets to said corpus m e mory . 

1 0. (Currently Amended) The method according to claim 9 3 further comprising the 

step of: 

3 
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storing to memory appending to said corpus mcta information and identification 
information related to said communication session, 

1 1 . (Currently amended) The method according to claim 10, wherein said module 
identifies words contained in said communication session as keywords that are found in a 
set of terms collected at ot »- < » f converting of -s aid v oi o o - information to text i s performed 
using voice/speech recognition and wher e in said step of automatically s e l e cting keywords 
is perform e d using artificial intelligence. 

12. (Currently amended) The method according to claim 1, further comprising the 
steps of: 

creating said database, and 

searching said database to find a communication session according to search terms 
provided by soid syst e m auser of said apparatus . 

13. (Currently amended) The method according to claim 12, further comprising 
the step of: 

reconstructing at least a portion of acommunication session found by said step of 
searching from said collected digitiz e d information packets ; and 

presenting said reconstructed selected communication session to said syst e m user 
for review, 

14. (Currently amended) A system including a personal computer (PC) situated in 
a non-commercial establishment and adapted to carry a communication session via a 
network, characterized by: 

a user interactive communication session collection and sort module a es ooiatod 
with said ?C 7 where the module is adapted to collect digitized information packets of said 
communication session and identifying keywords in text associated with said 
communication session for populating a database, which keywords are selected based on 
an ad-hoc keywords approach rather than on an a priori s e l e otkm preselected keywords 
approach. 
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15. (Withdrawn) . 

16. (Withdrawn) . 

17. (Currently amended) A broadband communication system, comprising: 

a personal communication module adapted for personal use by an individual to 
communicate with another party; 

a collection module that collects and stores primarily c ommunication sessions of bv 
said individual sel e ct e d from the group consisting of telephon e calls, multim e dia calls^ and 
instant messag e s , and 

an analysis module adapted to automatically select keywords from, and identify 
keywords contained in, said stored communication se ssions , 

18. (Withdrawn) ■ 

19. (Withdrawn) . 

20. (Currently Amended) The system according to claim 17, wherein said 
communication s e ssion is sa44 a telephone call* and speech , bv said individual is digitized 
and packetized, 

21 . (Currently Amended) The system according to claim 1 7, further comprising a 
module for encrypting information originating from said another party wh e r e in said 
communication s e ssion is said multim e dia call and spoooh is - digitized and pack e tized . 

22. (Withdrawn) . 

23. (Currently amended) The system according to claim 1 7, wherein said 
collection module determin e s wh e th e r s aid digitized information packets contain ^ voicc 
information and converts signal to be stored to v u iu ) ii ifoi mation contain e d in said 

5 
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digitized infonnation pack e ts into text information when said signal represents voice . 

24. (Currently Amended) The system according to claim 17 wherein said analysis 
module creates an indexed database that associates one or more of said keywords with each 
of said ses s ions communications t hat is stored by said collection module. 

25. (Previously Amended) The system according to claim 24, wherein the 
broadband communication system prompts said individual to determine preferred 
communication session identification terms and said keywords, and revises said 
identification terms and said keywords according to said preferred communication session 
identification terms and keywords. 



26. (Previously Amended) The system according to claim 25, wherein said 
digitized information packets includes outgoing packets for communications sent by said 
individual and incoming packets for communications sent to said individual by a party. 

27. (Previously Amended) The system according to claim 26, wherein said 
personal communication module determines whether approval has been given by said party 
to store said incoming packets for communications sent by said party. 

28. (Withdrawn) . 

29. (Withdrawn) . 

30. (Withdrawn) . 

31. (Withdrawn) . 

32. (Previously Amended) The system according to claim 17, wherein 

said collection module converts said voice information to text using voice/speech 
recognition; 



6 
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and said analysis module selects keywords using artificial intelligence. 

33. (Previously amended) The system according to claim 24, further comprising a 
search module that searches said database to find a communication session according to 
search terms provided by said individual. 

34. (Currently amended) The system according to claim 33, wherein said search 
module reconstructs at least a portion of sakl a communication session found by said 
search module from stored digitiz e d information paokot s information and presents said 
reconstructed communication session to said individual for review. 

35. (New) The method of claim 1 where said at least a portion of a 
communication session is limited to information provided by those parties who participate 
in said communication session and who permit recording of their information. 

36. (New) The method of claim 35 where permission is granted by a party who 
participates in said communication session through an entry of a code. 

37. (New) The method of claim 36 where information provided by parties, other 
than said individual, who participate in said communication session is included in said at 
least a portion of a communication session in encrypted form. 

38 (New) The method of claim 1 where said step of selecting keywords is limited 
to keywords contained in information provided by those individuals who participate in said 
communication session and who permit recording of their information. 

39. (New) The method of claim 1 , where information in said at least a portion of a 
communication session belongs solely to said individual. 

40. (New) The method of claim 3, further comprising the steps of 
prompting said individual, following said communication session, to provide 

7 
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keywords to be used by said module in said step of identifying, relative to said 

communication session. 

41 (New) A method executed in an apparatus of an individual, comprising the 

steps of: 

adding at least a portion of a communication session in which said mdwidual is a 
participant to a stored corpus of communication sessions; 

when said communication session is concluded, prompting said individual to 

provide keywords; 

including keywords provided by said individual in response to said prompting in a 

set of searchable keywords; 

identifying terms contained in said communication session that correspond to 

keywords in said set of searchable keywords; and 

adding to a database information associating terms in said communication session 
that correspond to keywords in said set of searchable keywords. 

42. (New) The method of claim 41 where said step of including appends the 
included keywords to keywords already in said set. 



8 
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REMARKS 

Claims 1-14, 17, 20-27, and 32-34 were rejected under 35 USC 103 as being 
| unpatentable over Beck et al, US Patent 6,167,395 in view of Flores et al, US Patent 

! 5,216,603. Applicants respectfully traverse. 

i Beck et al describe a call center arrangement that comprises workstations where 

I live agents can conduct person-to-person interactions with customers who wish to interact 

! with the enterprise that engages, or operates, the call center. The call center also includes 

I interactive voice response (IVR) equipment to allow customers to interact with the call 

| center without use of the live agents and, if appropriate, obtain information therefrom. In 

I some circumstances, the calls of customers are recorded and processed so that, at a later 

j time, during a "data mining" session, specialized dialog threads can be created when about 

j a specific predefined issue, or issue set, to thereby link a plurality of stored call sessions. 

| The dialog threads are presented to the agents at the workstations in order to allow the 

\ agents to provide service more effectively. 

j Operation of the call center is controlled by a customer-interaction network 

operating system (CINOS) and this operating system (OS) has specific described 

| functions, among which are capturing, analyzing, routing, and reporting (col. 7, lines 54- 

! 58). During capturing, the voice interaction is recorded and, simultaneously, a text version 

of the call is created. See steps 105 and 107 in FIG. 3 and associated text. Thereafter, in 
step 1 09, the text version is analyzed with "data mining" modules (as indicated above) to 

! augment the knowledge base about calls that are already stored in the system. Similar 

: behavior is carried out in steps 111,113, and 115. 

! One aspect of the Beck et al description is that the analysis is focused on what the 

! customers want, and there is no explicit teaching that the voice utterances and other 

! information that is provided by the call center's operators is analyzed. 

I Another aspect of the Beck et al description is that it has no teaching of any explicit 

asking of customers for permission to record information, and no teaching of what happens 
j when a permission is withheld. 

Still another aspect of the Beck et al operation is that the call center is an enterprise 
system; not a customer premises apparatus of an individual. 

The Examiner admits that Beck et al does not explicitly teach creating a database 

| 9 
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that contains selected keywords of a communication session, but asserts that Flores et al 
teach keyword association with present and past conversations. Applicants respectfully 
submit that even Flores et al teach what the Examiner asserts that they teach, applicants' 
claims are still not obvious in view of the two references because the significant 
differences between the subject claims and the Beck et al reference are not directed to that 
which the Examiner asserts that Flores et al teach. Therefore, the Flores et al reference 
does not supply that which is missing in the Beck et al reference and, consequently, the 
combination of the Beck et al reference and the Flores et al reference does not anticipate 
the subject claims. 

Specifically, relative to amended claim 1, it specifies, inter alia, the step of 
identifying keywords contained ir* said communication session, with aid 
of a module that operates without having received a list of said keywords 
nre-snectfied by said individual , for creating a database so as to permit 
subsequently searching through said database to find said 
communication session in said stored version (emphasis supplied) 
In contradistinction, Beck et al describe a system where there is no teaching of the data 
mining modules, but it is fairly clear that whatever modules are employed, they detect 
appearance of text (in, for example, speech converted to text) that matches predejmed 
issues or issue sets . In other words, amended claim 1 defines a step of identifying 
keywords that is diametrically opposite to the corresponding step in Beck et al. Hence, it 
is respectfully submitted that amended claim 1 is not obvious in view of the Beck et al and 
Flores et al combination of references. 

Additionally, the method defined in amended claim 1 is specifies to be executed in 
a "customer premises apparatus of an individual" that actively participates in the 
communication sessions. In Beck et al, in contradistinction, the method is executed in a 
call center's system, which is a system of an enterprise and not a "customer premises 
apparatus of an individual." This constitutes another reason to hold that claim 1 is not 
obvious in view of the Beck et al and Flores et al combination of references. 

Previously presented dependent claims 2-14, and new dependent claims 35-40 
depend on claim 1 and, therefore, applicants believed that these claims are also not obvious 
in view of the Beck et al and Flores et al combination of references. 

Moreover, at least some of the dependent claims contain limitations that make 
those claims independently patentable over the Beck et al and Flores et al combination of 

10 
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references. 

Claim 4 specifies prompting of the individual to specify terms to be used as 
keywords. Applicants respectfully submit that there is no teaching in either of the 
references of such prompting. The Examiner points to the Beck et al abstract's reference 
to "analyzing association criteria and making a selection based on that criteria" (page 3 of 
the Office Action), and the abstract does state that the described multimedia call center has 
"a search function that searches accessed data for association criteria" (abstract, lines 6-7). 
However, neither this phrase nor any other passage in the abstract contains any teaching as 
to the source of the association criteria, and certainly not that such association criteria (or 
keywords) are obtained from (a) the individual and (b) in response to a prompt. Therefore, 
amended claim 4 specifies a limitation that is clearly not found or suggested in the Beck et 
al and Flores et al combination of references. 

Regarding claim 6, which illustratively pertains to an explicit approval to record 
another party's conversation, the Examiner points to the "logging into a network via 
password protection" that is shown in FIG. 6. Respectfully, the log-in step that is shown in 
FIG. 6 relates to a situation where a visitor wishes to be a client (see col. 18, lines 1 1 et 
seq.) and to perhaps gbtain some information. It has nothing to do with permission granted 
to record a conversation - which in many US jurisdictions is legally required. Hence, 
applicants believe that claim 6 is not obvious in view of the Beck et al and Flores et al 
combination of references. 

Regarding claim 8, the Examiner points to col. 25, line 60 though col. 26, line 17. 
The cited passage addresses the abilities of customer-users who call in to access 
information. That is clearly not what claim 8 addresses. Rather, the converse, claim 8 
protects data that was sent to the apparatus from outside the apparatus. This is akin to 
protecting information provided BY the customer users from access by the call center's 
operators/administrators/owners. No such notion is present in the cited passage or 
elsewhere in Beck et al. Therefore, it is believed that claim 8 is not obvious in view of the 
Beck et al and Flores et al combination of references. 

As for claim 11, which specifies that the terms that constitute the keywords are 
collected using artificial intelligence, the Examiner asserts that Beck et al teach 
voice/speech recognition to convert to text using keywords, citing col. 21 , lines 35-47. 

11 
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j Applicants respectfully traverse. First, the cited passage states: 

I An intelligent peripheral in the form of a COST IVR 177 is Provided for 

; the purpose of interacting with callers seeking information -and the like 

who do not require connection to a live agent. IVR technology may 
j comprise voice response, touch tone interaction, or a combination ot 

I these technologies. IVR 177 is linked to processor 179 and also to 

I automated services 193. An example of an IVR interaction may be the 

! presentation to a caller of options for using an automated service such as 

| those described above, or perhaps waiting for a live agent. 

I As can be seen from even a quick reading of the passage, voice or speech recognition is not 

j mentioned, and nor are keywords. Second, applicants respectfully submit that Beck et al 

j do not teach the notion of converting speech to text using keywords. Third, nowhere in the 

j Beck et al reference is there a mention of artificial intelligence - relative to keyword 

j selections, or otherwise. Therefore, it is respectfully submitted that claim 1 1 contains a 

! limitation that independently forms a reason to hold the claim not obvious in view of the 

Beck et al and Flores et al combination of references. 
| As for claim 1 2, the Examiner points to FIG. 7 for its alleged teaching of searching 

the database. Applicants respectfully traverse. The most that can be said is that FIG. 7 
shows the existence of an MIS database segment in a storage device, and a text-based data 
segment in the storage device. Respectfully, having data in a storage device does not ipso 
facto teach searching through the data. Moreover, claim 1 1 does not merely specify 
searching a database. Rather, it specifies searching the database to find a communication 
session according to search terms provided by a user of the apparatus . FIG. 7 does not 
teach this, and neither does any text passage of the Beck et al reference. It is respectfully 
submitted, therefore, the claim 12 presents a limitation that forms an independent reason to 
hold the claim not obvious in view of the Beck et al and Flores et al combination of 
references. 

New claim 35 focuses on permission granted by parties to the communication. As 
indicated above, Beck et al have no notion of permission granted by customer users. 

New claim 36 specifies an entry of a code by a party as an indicationof a 
permission to record that party's communication. As indicated above, Beck et al have no 
such notion, and the password mentioned by Beck et al is, at best, a code that is provided 
in an effort by the customer party to get information, rather than a permission for the call 
center to have permission to analyze and record the customer's information. 
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New claim 37 specifies encrypting information. No such notion is present in Beck 

et al. 

New claim 38 specifies that the keywords are limited to information provides by 
the individual who owns the apparatus. This is akin to specifying that the "association 
criteria" of Beck et al are limited to information provided by the call center's operators. 
Clearly, no such notion is present in or suggested by Beck et aL 

New claim 39 limits the recording only to the individual- This is akin to recording 
only the information originating from the call center's operators. Clearly, no such notion 
is present in or suggested by Beck et al 

New claim 40 specifies prompting the individual for key words (a notion addressed 
in connection with claim 4), and specifies a particular timing for such prompting 
("following said communication session"). No such notion is present in or suggested by 
Beck et aL 

As for claim 14, applicants respectfully direct the Examiner's attention to the 
phrase "which keywords are selected based on an ad-hoc keywords approach rather than 
on preselected keywords approach" (emphasis supplied), and to the arguments presented in 
connection with claim 1 . Applicants respectfully submit that Beck et al in combination 
with Flores et al employ a preselected keywords approach and not an ad-hoc keywords 
approach and, therefore, claim 14 is not obvious in view of the Beck et al and Flores et al 
combination of references. 

Independent claim 1 7 specifies that the information that is stored is "primarily 
communication by said individual." To correspond to the Beck et al teachings, that would 
mean that the information stored by the Beck et al system would be primarily information 
originating from the call center operators, That is clearly not what Beck et al teach. 
Therefore, it is respectfully submitted that claim 17 is not obvious in view of the Beck et al 
and Flores et al combination of references. 

Claims 20, 21, 23-27, 32-34 depend on claim 17 and are, therefore, believed to also 
not be obvious in view of the Beck et al and Flores et combination of references. 

In is noted, additionally, that claim 21 specifies encrypting of information 
originating from a party other than the individual who owns the apparatus. In the Beck et 
al system this would correspond to encrypting of information obtained from the customers. 
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No encrypting whatsoever is discussed in the Beck et al reference. Accordingly, it is 
respectfully submitted that claim 21 contains a limitation that independently leads to the 
conclusion that the claim is not obvious in view of the Beck et al and Flores et al 
combination of references. 

As for claims 25, 27, 32, and 33, the Examiner's attention is directed to the 

arguments offered in connection with claim 4, 8, 1 1 , and 12 respectively. 

New Claim 41 recites a number of the limitations discussed above, which are not 

found in either Beck et al or in Flores. It is respectfully submitted that claim 42. which 

depends on claim 41 are not obvious in view of the Beck et al and Flores el al combination 

of references. 

In light of the above amendments and remarks, applicants respectfully submit that 
all of the Examiner's rejections have been overcome. Reconsideration, and allowance of 
the remaining claims are respectfully solicited. 



Respectfully, 




Phone (973)467-2025 

Fax (973)467-6589 

email brendzel@comcast.net 
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